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Abstract- In recent years, Home Automation systems have seen rapid changes due to the 
introduction of various wireless technologies. Zigbee is targeted at applications that require low data 
rate, long battery life, and secure networking and has a maximum rate of 250 kbits/% ^el^ 
suited for periodic or intermittent data or a single signal transmission from a sensor or input c^^|e. 
This paper discusses the design of a system that allows the user to interact with it via his or hewyoi^ in 
natural language and maps user utterances to predefined instructions, including the switfirtflg °f a 
light or electrical appliance. The system is intended to control all lights and electrical a^Qutfces in a 



home or office using natural language. Having a comfortable learning curve and bein§frraW[s free by 
design, the system intends to make home control easier and more convenient. 
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I. Introduction OSbT 

The recognition and understanding of spontaneous unrehearsed speech^e^aii^an elusive goal in the area 
of computing. A human considers not only the specific informatioif ^ia\yved to the ear, but also the 
context in which the information is being discussed. For this r^^ja\people can understand spoken 
language even when the speech signal is corrupted by noise. HowevCrjteiderstanding the context of speech 
is, in turn, based on a broad knowledge of the world. This has tb^^jpeen the source of difficulty and over 
forty years of research. The Home Automation industry is gto\wFg rapidly; this is fuelled by the need to 
provide supporting systems for the elderly and the disabJ^oN^pecially those who live alone. Coupled with 
this, the world population is confirmed to be getting d^r/Tiome automation systems must comply with 
the household standards and convenience of usage. TflliXJaper details the overall design of a voice activated 
home automation system (VAHAS) which has befci^jpuilt and implemented. The automation centers on 
recognition of voice and uses low-power RFafcgBee wireless communication modules. The home 
automation system is intended to control alfli^its and electrical appliances in a home or office using 
voice. The system has been tested and vejAedrThe tests involved a mix of 10 male and female subjects with 
different English accents. 5 different ta«fs were activated by each person. 




II. Design 
A. Hardware 

1) Main Device: This dpvkj^s responsible for practically all the computation and serves as the primary 
controller in the me|f^OTi^ork. The device is powered by the Raspberry Pi, which is a credit-card-sized 
Linux based micop^fcputer and is popular amongst the global DIY community. The Pi features the 

ARM1176JZF-S Xlw 6k ) 

processor clocked at 700 MHz and features 512 MB of RAM. Capable of running 
Arch Linux ^#fftQkid requiring only 3.5 W of power for general functioning, it is a capable and efficient unit 
and serve^|u^)urpose well. The Pi is connected to an audio interface via USB which in turn is connected 
to a srrfljjvmphragm condenser microphone. This sums up the audio input section of the device. In 
addit fcnVo the already mentioned peripherals, the Pi is connected via its GPIO pins to an XBee Series 2 
r IT-oo4 module from Digi which is essentially a serial ZigBee Network compatible RF module, 
illows the device to communicate with the Switch. 




2) Switch: The Switch is what lies at the other end of the network and its plurality has no limitations, 
since every appliance or power outlet to be controlled requires one of these to interface with the Main 
Device. The Switch is essentially powered by means of an 8-bit Atmel AVR microcontroller, pre- 
programmed with the Arduino boot loader that makes development easy using the Arduino integrated 
development environment (IDE) and C or C++ code. The microcontroller is interfaced via RS-232 with a 
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matching XBee Series 2 XB24- Z7WIT-004 module for RF communication with the Main Device. A solid 
state relay connected to the microcontroller enables it to switch high power circuits. 

B. Software 

1) PocketSphinx: Atop the Linux kernel running on the Main Device, is PocketSphinx, a lightweight 
speech recog- nition engine capable of keyword spotting and dictation using limited vocabularies and 
dictionaries tuned to the current application domain. Several changes have been made to the spe^h 
recognition code to make it suitable for real time input and to increase its accuracy in the^ 
environments. The output from the engine essentially consists of detected utterances which are 
redirected to another component written using OpenDial. * 

2) OpenDial: OpenDial is a Java-based software toolkit to facilitate the developmerfC^^obust and 
adaptive spoken dialogue systems. The toolkit itself is domain-independent and c^rjfce easily applied to 
any particular dialogue domain. Dialogue understanding, management and generatjorka^e ex- pressed in 
OpenDial through probabilistic rules encoded in a simple XML format. This is us^ffiyflfap user utterances 
to specific system actions, and keep the future possibilty of the system responAagJilick to the user, open. 
Since this component is in Java, JNI is used to interface with the previously me^j/oned speech recognition 
component in C, and the output of this is sent back to the main funcion^^pTlih $s responsible of sending the 
required instruction over RF to the particular Switch. 

3) Firmata: Since low level pin access is required to ma- nipulat^d^^ppliance connected to the Switch in 
question, the Firmata protocol was adopted for communicationjj^j^een the Main Device and the Switch. 
Firmata is a generic protocol for communicating with microcontrollers from software on a host computer. 
It is intended to work with any host computer software p^"^£^. There is a matching object in a number of 
languages. 




entation 



The following diagram illustrates the diffej^talgorithms involved in the system and their inter-working. 
As one can see, the speech from the jm^^.s captured by the microphone and is converted to digital 
information by means of the audicain^flS^. The digital data is then transferred to the Pi via USB which is 
read constantly by the Listener cod 



When the audio input crossgg^]jg|bnd a threshold of -10 dB, the algorithm calls the PocketSphinx code, 
which parses every utter^od^^at includes a trailing and a leading 150 ms of silence. This indues an inbuilt 
noise reduction algoritl^iVnat uses a CMM adaptive noise filter. The output from the PocketSphinx 
application is then se/y^l^T parameter to the Java function that parses the input for intent. 

After the inten\j\iililised using the XML probabilistic rules file, the resulting instruction is sent via the 
XBee API to ^^^Jrtiuino Switch device in question, using the Firmata protocol. 
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The Arduino which is constantly polling its seriaNqput, parses the instruction and does the necessary 
action. This would usually involve writing i/OIlo to a digital or an analog pin, which would result in the 
appropriate appliance switching on or off r^pSctively. 

IV. Results 



The system was tested on a 
them was asked to execute 
instructions 86.67% of t^iJv 
of 150-200 ms, thus satis^mfe 

ST 





30 males and females with different accents in English and each one of 
ifferent instructions. The system was able to accurately identify the 
The system was also able to respond to a user's speech within an average 
e requirements and resulting in an easy to use and responsive system. 

V. Future Work 



The voice re#^g\nbn engine that is being used in the system is language independent and thus may 
be scaled tdul^ny other locales. Dictionaries and language models of other languages can be created using 
the tookafr^able with the system, and the system can thus be trained to detect and parse other languages 
quit e^a\ryr The system could be made to run faster if deployed on better hardware. Since, most of the code 
ly portable, scalability should not be a problem. 

VI. conclusion 



The VAHAS is a useful project for adults and physically disabled persons, who are not able to do various 
activities efficiently when they are at home and need ones assistant to perform those tasks. With the 
Voice Recognition along with ZigBee network we can eliminate the complication of wiring in case of wired 
automation and also it prevents to get up and down again and again to on/off appliances. ZigBee Home 
Automation provides operating range much higher as compared to Bluetooth and other wireless sensor 
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module. The system provides secure access to the home or office. Since it is language independent, the 
system can be scaled to many other locales. Also, since internet connectivity is not a requirement, the 
system may be used in locations without sufficient bandwidth penetration. 
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